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I.  Introduction 


In  Granger's  definition  one  is  concerned 
with  being  eible  to  predict  one  variable  from 
past  values  of  itself  and  another  variable.  As 
a criterion  of  goodness  of  the  prediction 
Granger  employs  mean  squared  error.  Thus  one's 
initial  attenpt  at  determining  if  causes 

would  be  to  regress  present  on  past  X^  and  Y 
according  to 


A post  hoc  data  analysis  in  hopes  of  identi- 
fying causal  relationships  between  varieUsles  is 
one  that  should  be  regarded  with  a great  deal  of 
suspicion.  One  need  merely  consider  the  etymo- 
logy of  the  word  "malaria"  to  realize  that  unless 
all  factors,  or  variables,  are  taken  into  consid- 
eration or  experimentally  controlled  erroneous 
conclusions  concerning  cause  and  effect  may  be 
reached. t It  is  for  this  reason  that  statisti- 
cians prefer  to  speak  in  terms  of  "predictability" 
or  "correlation"  rather  than  "causation". 

In  economics,  however,  a great  deal  of  re- 
search has  recently  been  published  concerning 
causal  realtionships  between  economic  variables. 
The  basis  for  this  research  stems  from  a defini- 
tion of  causality  given  by  C.  W.  J.  Granger 
(1964).  Basically  this  definition  states  that  if 
one  cem  predict  the  future  values  of  one  variable 
X^  using  all  past  values  of  all  other  variables 

in  this  system  better  them  when  predicting  future 
using  all  past  values  of  all  other  vari2d>les 

in  this  system  except  those  of  Y^,  then  Y^  causes 
X^.  It  is  important  to  note  that  this  definition 

contains  a universe  of  variables  related  in  some 
system.  In  reality,  of  course,  it  is  impossible 
to  measure  all  the  factors  in  the  system.  Hence 
it  may  appear  that  Y^  is  causing  X^  when  indeed 

a third  variable  is  causing  )30th  and  Y^. 

Granger  is  careful  to  point  this  out  in  his  dis- 
cussion of  the  definition. 

The  inability  to  measure  all  variables  in 
the  universe  certainly  exists  in  economics.  How- 
ever, when  an  economic  theory  indicates  that  a 
change  in  one  variable  should  cause  a change  in 
^^lother,  it  may  be  necessary  to  identify  a statis- 
tical relationship  between  these  variables,  a 
relationship  which  could  quite  possibly  be  causal 
but  could  not  be  proven.  Thus,  though  some 
critics  may  argue  the  use  of  the  word  "causality", 
we  shall  use  this  term  with  the  understanding  of 
what  it  connotes  in  this  situation.  Wholesale 
use  of  techniques  for  identifying  casuality  with- 
o ut  sound  economic  reasons  for  justifying  such 
techniques  should  be  avoided. 

Granger's  definition  of  causality  is  Impor- 
tant in  that  not  only  does  it  appeal  to  our  in- 
tuition as  a reasonable  definition,  it  also  lends 
itself  to  statistical  analyses  for  causality  de- 
tection. The  appropriate  analysis  to  be  used, 
though,  is  not  apparent.  In  the  next  section  we 
propose  some  analyses  that  seem  natural  in  this 
situation  but  which  should  not  be  used  because  of 
certain  deficiencies.  The  elimination  of  these 
deficiencies  leads  to  what  we  propose  for  cau- 
sality which  is  given  in  the  fourth  section. 

This  discussion  will  consist  of  a universe  of 
only  two  variables,  however,  the  extension  to 
more  than  two  variables  follows  readily. 


where  e^-NID(0,o  ).  A significant  F-ratio  for 

testing  H : b.  • 0,  i > 1,  . . . , m,  would  imply 
o 1 

that  Y^  causes  X^.  This  result,  though,  would 

surely  be  suspect  because  in  most  economic  time 
series  a definite  trend  exists  with  respect  to 
time.  This  trend  in  time  present  in  both  series 
could  manifest  itself  in  the  significance  of  the 
coefficients  in  the  Y^  series  when  indeed  Y^ 

does  not  cause  X^. 

The  next  consideration  then  would  be  the  re- 
moval of  or  an  adjustment  for  the  time  variable. 
In  the  terminology  of  time  series  analysis  our 
aim  )3ecomes  the  transformation  of  the  original 
series  to  stationary  time  series.  We  use  the 
term  "stationary"  to  describe  a time  series  with 
constant  mean  having  autocovariance  a function 
only  of  the  lag  between  observations.  This  con- 
dition on  the  autocovariance  function  implies 
also  constant  variance.  Departure  from  constant 
variance  may  be  corrected  via  some  transformation 
as  the  logarithm.  As  indicated  by  Box  and 
Jenkins  (1976)  stationarity  with  respect  to  the 
mean  can  be  achieved  by  suitably  differencing 
the  individual  series  involved.  For  example,  if 
a linear  trend  is  present  in  the  data  then  one 
would  consider  the  series  U^  = X^  - X^  Had 

the  trend  had  a single  periodic  component  then  a 
second  difference  would  be  required,  namely, 

u;  - «t  - Vr 

We  return  then  to  the  regression  model  (2.1) 
where  we  realize  now  that  the  X^  and  Y^  are  the 

results  of  the  differencing  necessary  to  produce 
stationarity.  New  problems  arise,  however,  that 
cause  the  results  of  a classical  regression  anal- 
ysis based  on  the  F-test  to  be  suspect.  The 
standard  assumptions  for  the  F-test  are  that  the 
values  of  the  dependent  variable  are  normally 
and  independently  distributed  and  that  the 
values  of  the  independent  vari2d>les  are  fixed. 

In  our  situation  the  values  of  the  "dependent" 
variable  are  not  necessarily  independent  (and,  in 
fact,  are  most  often  correlated).  Furthermore 


492 

Raprirftad  from  th«  1976  ButinoM  arid  Economic  StatMics 
Section  Procaadlnga  of  the  American  StatMIcal  Aaaociatlon* 


PtiIbnfleB  UnKnifed 


o a Q 


tWe* 'V^cIrnfJMependence  Is  not  due  to  correlated 
errors  (Mr^*|ould  be  adjusted  for)  but  due  to 
the  fact  t)^^  ^he  "independent”  variables  are  not 
fixed  blit  In  fact  the  "dependent"  vari- 
able at  t is  one  of  the  “independent"  vari- 

ables 4t  sbnte  future  time  t + k.  It  is  this 
structure  that  arouses  questions  concerning  the 
distribution  of  the  regression  statistic  and  thus 
the  validity  of  the  test. 

It  should  also  be  noted  that  this  regression 
technique  at  this  point  falls  for  euiother  impor- 
tant reason.  It  has  been  shown  [Jenkins-Watts, 
p.  338,  (1968))  that  even  if  and  are  inde- 
pendent processes  having  autoregressive  structure 
that  spurious  cross-correlations  are  possible. 
These  spurious  cross-correlations  could  manifest 
themselves  in  significant  values  for  some  of  the 
Y^  coefficients  in  (2.1)  implying  causality  when 

in  fact  none  exists. 

III.  A More  General  Model 

Since  the  regression  model  (2.1)  has  been 
shown  to  have  serious  deficiences  In  the  ensuing 
analyses,  we  next  consider  two  different  models 
and  the  relationship  between  them.  The  models  to 
be  considered  are  the  univariate  autoregressive- 
moving  average  representation  for  each  of  two 
series,  X^  and  Y^,  and  the  bivariate  autoregres- 
sive representation  of  X^  and  Y^  jointly.  The 
series  X^  and  Y^  are  assumed  to  be  appropriately 

transformed  or  differenced  so  that  each  series  is 
covariance  stationary.  Furthermore,  we  shall 
assume  that  the  true  causal  relationship  has  re- 
mained in  the  residuals  X^  and  Y^,  although  this 

assumption  may  be  sensitive  to  t)ie  nature  of  the 
prefiltering  (especially  when  nonlinear  trans- 
formations to  achieve  stationarity  are  used). 

The  univariate  models  are: 


♦^(B)  X^  - 0^(8)  u^ 


♦^(B)  Y^  - 62(8)  v^ 


(3.1) 


where  1^,  9^,  and  0^  *te  finite  degree  poly- 
nomials in  B (where  B^'x^  • X^  j^)  having  constant 
term  I and  u^  and  v^  are  white  noise  processes. 

The  processes  are  strictly  autoregressive  if 
0 MB)  « 1,  I « 1,  2,  and  strictly  moving  averages 

if  (B)  > 1,  i • 1,  2.  The  assumption  that  X^ 
and  Y^  are  stationary  implies  that  the  roots  of 
♦^(2)  “ 0 lie  outside  the  unit  circle.  We  can 
subsequently  rewrite  (3.1)  as 

Xt  ■ (B)  (B)  u^  - (B)  u^ 


(3.2) 


Yj,  - *2  ®2  ''t  " ®2  ''t' 

where  ^ (B)  and  0^  ^ (B)  are  infinite  series  in 
B provided  they  are  not  identically  1. 


The  bivariate  autoregressive  representation 
is  given  by 


(3.3) 


where  P,  Q,  R,  and  S are  polynomials  of  the  form 

k 


P(B) 

fi(B) 

■ 

R(B) 

S(B) 

Y 

t_ 

A(B) 


I 

k-0  * 


with  the  constant  term  in  P and  S strictly  1 and 
and  b^  are  white  noise  series  with 

J (diagonal) , k«0 

♦ , k+0 


“t+k  ^t+k 


Itie  series  are  stationary  if  tlie  roots  of 

P(Z)  Q(2) 

R(Z)  S(Z) 

lie  outside  the  unit  circle. 

The  relationship  between  these  tvo  repre- 
sentations can  be  given  in  terms  of  their  white 
noise  innovations.  From  (3.2)  we  can  rewrite 
(3.3)  as 


P(B) 

n 

C(B) 

0j(B)  0 

“t 

M 

R(B) 

S(B) 

0 0,  (B) 

V 

b 

J 
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0^(B) 
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which  with  substitutions  of  t)«  form 
P*(B)  - P(B)  0^(B)  yields 


P*(B) 

(J*(B) 

u 

t 

m 

t 

R*(B) 

S»(B) 

b 

Expressing 


- " 

u 

t 

in  terms  of  the 

V 

yields 


^ F(B)  S»(B)  -F(B)  Q»(B) 

-F(B)  R»(B)  F(B)  P«(B) 

which  in  single  equation  becomes 


u^  • F(B)  S«(B)  a^  - F(B)  Q*(B)  b^ 


(3.4) 


v^  « -F(B)  R»(B)  a^  ♦ F(B)  P*(B)  b^  , 
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where  F(B)  « 1/(P*(B)  S*(B)  - Q*(B)  R»(B)).  Thus 
and  are  related  to  one  another  via  a^  and 

according  to  (3.4).  It  is  this  pair  of  equations 
that  can  be  used  to  determine  the  causal  rela- 
tionship between  u and  v , that  is,  between  X 


u^  be  white  noise.  In  a regression  u^  on  it 
is  clear  that  represents  the  error  in  the  re- 
gression. It  is  well  known  that  such  autocorre- 
lation among  the  error  terms  can  result  in  bi- 
ased estimates  of  the  variances  rf  the  least 
squares  estimator  of  the  regression  coefficients 
(see  Appendix  A) . This  causes  concern  in  that 
one  might  ten'*  to  reject  true  null  hypotheses 
more  often  than  the  significance  level  of  the 
test  would  indicate  o£  one  might  tend  to  not  re- 
ject a false  null  hypothesis  when  indeed  he 
should.  As  indicated  in  Appendix  A the  nature  of 
the  autocorrelation  of  the  "independent"  vari- 
able determines  which  of  the  above  is  the  situ- 
ation. In  the  case  of  unidirectional  causality 
when  using  a forward  stepwise  regression,  it  is 
easy  to  see  that  at  each  step  the  next  possible 
"independent"  regression  variable  to  enter  the 
model  is  indeed  uncorrelated.  In  this  case  the 
estimator  of  the  error  variance  is  asymptotically 
unbiased  and  for  small  samples  the  bias  should  be 
negligible  (our  simulations  using  around  60  ob- 
servations have  indicated  no  consistent  bias  in 
estimates  of  the  error  variance).  Hence  the  use 
of  ordinary  least  squares  in  a forward  stepwise 
regression  is  valid. 

In  the  case  where  Y causes  X (or  X 
t t t 

causes  Y^)  and  instantaneous  causality  is 

present,  the  polynomials  Q*(B),  P*(B),  and  S*(B) 
each  have  constant  term  1.  Thus  u will  be  a 
function  of  present  and  past  v^  anS  similarly  in 

(3.6)  v^  a function  of  present  and  past  u^. 

Hence  the  criterion  for  instantaneous  causality. 
(It  should  t)e  noted  that  this  criterion  only 
identifies  the  existence  of  instantaneous  cau- 
sality. Whether  X causes  Y , Y^  causes  X , or 
t t t t 

instantaneous  feedback  cannot  be  determined.) 

When  feedback  is  present  in  the  system, 
both  Q(B)  and  R(B)  are  nonzero  polynomials  in  B 
with  constant  term  zero  (assuming  no  instantane- 
ous causality).  Equation  (3.4)  may  now  be  ex- 
pressed as 


If  no  causal  relationship  exists  between  X^ 
and  Y , then  Q(B)  • R(B)  - 0 and  (3.4)  reduces  to 


that  is,  the  white  noise  innovations  u^  and  v^ 

have  cross  correlation  zero  for  all  lags. 

Under  a null  hypothesis  of  no  causality  and  as- 
suming that  a^  and  b^  are  Gaussian,  a regression 

of  u^  on  past,  present,  and  future  v^  based  on 

the  standard  test  statistic  which  does  indeed 
follow  an  F distribution  should  find  no  signifi- 
cant coefficients. 

In  the  case  of  unidirectional  causality, 
say  Y^  causing  X^,  R(B)  » 0.  Substituting  these 

into  (3.4)  yields 


Assuming  for  now  no  instantaneous  causality,  the 
operator 


(B)  S*  (B)  * polynomial  in  B having 

constant  term  zero.  Thus  u is  a function  of 


past  v^.  Rewriting  the  first  equation  in  (3.5)  to 
express  v in  terms  of  u produces 


The  operator  on  u^  will  contain  terms  of  the 

form  B m>  0 (as  well  as  B*"  terms  perhaps), 
implying  that  v^  will  t>e  a function  of  future  u^ 

(as  well  as  possibly  present  and  past  v^).  A 
forward  stepwise  regression  finding  u^  a function 
of  only  past  and  v^  a function  of  future  and 
possibly  present  and  past  u would  thus  indicate 
that  Y^  causes  X^. 

A closer  look  at  (3.S)  might  arouse  some 
concern  alsout  an  ordinary  least  square  regres- 
sion of  u on  v^.  In  general,  the  first  term  A^ 
t t t 

is  a seving  average  in  a^  and  the  second  term  B^ 

is  a Bloving  average  in  b^.  Thus  each  term  re- 
presents an  autocorrelated  series.  The  nature  of 
this  autocorrelation  is  such  that  when  A^  is 

correlated  P|^  at  lag  k the  second  term  B^  must 
have  autocorrelation -0.  at  lag  k in  order  that 


where  A,  and  B.  have  constant  term  1 and  A.  and 


B^  have  constant  term  0.  Considering  u^  as  a 
linear  combination  of  the  v implies 


Now  A^(B)A2  contains ^negative  powers  of  B as 
well  as  positive  powers.  Thus  u^  is  a function 

of  past,  future,  and  possible  present  values  of 
v^.  A symnetrlc  argument  holds  for  v^  as  a func- 
tion of  u^.  Hence  the  criterion  for  determining 
feedback  In  the  system,  ha  in  the  unidirectional 


case  the  absence  of  autocorrelation  in  the 
"independent"  regressor  variables  substantiates 
the  validity  of  ordinary  least  squares  for  the 
regressions. 

IV.  The  Resulting  Procedure 

In  suimary,  the  procedure  that  has  arisen 
naturally  from  the  earlier  discussion  is  outlined 
as  follows: 

1.  Individually  transform  (e.g. . taking  the  nat- 
ural logarithm  of  the  observations)  or  dif- 
ference (e.g.,  taking  the  first  difference  to 
remove  a linear  trend)  each  time  series  to 
yield  covariance  stationary  residual  series 
denoted  by  and  V^. 

2.  Individually  model  each  series,  and  Y^,  as 

an  autoregressive-moving  average  process  ac- 
cording to  the  techniques  developed  by  Box 
• and  Jenkins  (1976). 

3.  Filter  X^  and  Y^  according  to  their  estimated 

models  to  yield  the  white  noise  innovations 
u^  and  v^  respectively. 

4.  Use  a forward  stepwise  regression  of  u^  on 
future,  present,  ^uld  past  values  of  v^  and  a 
similar  regression  of  v^  on  u^. 

5.  Determine  the  causal  relationship  as  follows: 

a.  No  causality,  — u^  is  not  a function  of 

any  of  the  future,  present,  or  past 
values  of  v^  nor  is  v^  a function  of  any 

such  u^ . 

b.  Y^  causes  X^  (and  similarly  for  X^  causing 
Y^)  but  not  instantaneously  — u^  is  a 
function  only  of  past  v^  and  v^  is  a func- 
tion of  future  and  possibly  present  and 
past  u^. 


c.  Instantaneous  causality  — 


Is  a func- 


tion of  only  present  and  past  v^  and  v^  is 
a function  of  only  present  and  past  u^. 

d.  Bi-directional  causality  — u^  is  a func- 
tion of  future,  present,  and  past  v^  and 
similarly  v^  a function  of  future,  present, 
and  past  u^. 

We  advocate  this  procedure  because  (1)  it 
generalizes  to  the  multivariate  case  and  there- 
fore serves  as  a basis  for  the  detection  of  cau- 
sality in  systems  of  two  or  more  variables  and 
(2)  the  use  of  a stepwise  regression  serves  not 
only  to  determine  the  direction  of  causality  but 
also  to  deteimlna  the  causality  lag.  The  latter 
is  an  important  step  in  system  identification. 

For  exaiRple,  consider  that  unidirectional  cau- 
sality has  been  detected  from  Y^  to  X^.  From 

our  regression  analysis  we  have  estiawted 
- in  (3-5)  and  from  our  original 

modelling  we  have  estiswted  9^(B>  and  6j(B).  A 
Box-Jenkins  analysis  of  the  residual  series  A^ 

-■■ij 

-.  ••  *4 


will  yield  an  estimate  of  P*(B)  and  hence  P(B). 
Since  S*(B)  - 1 an  estimate  for  0*(B)  can  be  ob- 
tained and  hence  Q(B).  From  this  analysis,  then, 
we  can  estimate  the  original  model 


P(B)  Q(B) 


(knowing  that  R(B)  • 0 in  this  case). 

V.  Applications  of  the  Procedure 

In  order  to  demonstrate  the  application  of 
this  procedure  in  bivariate  situations  the  re- 
sults of  a simulation  and  an  analysis  of  two 
economic  tines  series  are  given.  The  results 
concerning  the  economic  time  series  are  quite 
interesting  in  that  they  differ  from  ^my  other 
results  yet  published. 

For  the  simulation  88  observations  were 
generated  for  each  of  two  series  X^  and  Y^  ac- 
cording to 


.7Xt-i  + ♦ a^  , a^,'NID(0,l) 


Y^.  » - •5Y^_2  + b^,  b^-NID(0,l)  . 

Due  to  the  choice  of  coefficients  the  processes 
are  stationary.  A Box-Jenkins  modelling  of  the 
series  individually  yielded 


\ ■ -"^X^-l  - -^^’^-2 


Yt  . .850Y^.^ 


u - .257  „ 

t t-8 


Upon  filtering  each  series  to  yield  u^  and  v^ 
and  performing  forward  stepwise  regressions  of  u^ 
on  v^  and  v^  on  u^,  the  models  obtained  were 

"t  ■ •®^V2  ^ * •^■'''t-4 

- • 35v^  j ♦ error 

(F^  - 11.25  R^  « .41  D.W.  - 2.61) 

4 


v^  - * error 


(F,  * 21-03  R - .39  D.W.  - 2.47) 

2 , 66 

These  results  indicate  causality  from  Y^  to  X^. 

It  is  also  interesting  to  note  the  magnitude  of 
the  Durbin-Watson  statistics  indicating  the  an- 
ticipated serial  correlation  for  the  error  terms. 

Applying  our  technique  to  quarterly  obser- 
vations of  the  money  supply  and  GNP  for  the  pe- 
riod 1953  through  1974,  we  arrived  at  the  follow- 
ing model  for  GNP: 

- (1-B)  In  (GNP) 

(G^  - .007)  - .449(G^_^  - .007)  ♦ 

’t  “ ®t  ■ ‘°t  ■ • 


» 


That  is  the  first  differences  of  the  natural  I09 
of  GNP,  which  is  approximately  equivalent  to  the 
rate  of  growth  from  quarter  to  quarter  (a  trans- 
formation necessary  to  achieve  stationarity ) can 
be  modeled  as  a simple  first  order  autoregres- 
sive (AR)  process. 

For  money  (Ml) . the  model  is 


- (1  - B)  In  (Ml)^ 


(M^  - .004)  - .63(M^_^  - .004) 


" ^ - -^^^Vio 


"t  " ^t  “ 

- •63(M^_^  - .004)  ♦ .259Z^_j^^  . 

That  is,  the  first  differences  of  the  natural 
logs  of  money  is  described  by  an  autoregres- 
sive - moving  average  (ARMA)  model.  The  resid- 
uals of  these  correctly  filtered  series,  g^  and 

m^,  can  now  be  used  in  a regression  to  test  for 
causality. 

Using  a forward  selection  regression  pro- 
cedure combined  with  the  properly  prefiltered 
values  of  money  and  GNP,  we  arrived  at  the  fol- 
lowing models; 

g • .49  , ♦ .68m  , ♦ .42m  , - .54m 

t mt-2  t-3  t+1  t+3 

(.1850)  (.1874)  (.1831)  (.1880) 

R^  - .2775  F(4,65)  - 6.2408  D.W.  = 2.41 


"t  ‘ 


(.0649)  (.0647) 

R^  « .1573  F(2,67)  - 6.2520  D.W.  - 2.1097  , 

where  the  values  in  parentheses  below  the  coef- 
ficients are  the  standard  errors  of  the  regres- 

2 

sion  coefficients.  In  both  regressions,  the  R 's 
are  small  but  still  significant  at  the  .05  level. 

Of  course,  when  evaluating  this  R^,  it  must  be 
remembered  that  the  values  used  in  the  regres- 
sion were  the  residuals  of  previous  models. 

Hence,  the  explanatory  power  of  these  models  is 
actually  quite  good.  Since  coefficients  of 
future  values  appear  in  both  regressions  signif- 
icantly different  from  zero,  we  have  identified 
a bidirectional  or  feedbac)c  relationship  between 
money  and  income. 


APPENDIX  A 


Consider  the  model 


Ft  - ♦ S 


where  x^  and  z^  are  zero  mean  proce 


having  variance  a and  autocorrelation  p.  . The 
z k 

variance  of  the  ordinary  least  squares  estimator 
b of  B given  by 

b - (x'a)'^  jt’y 


Var  (b)  - (x'x)  ^ x'Vx(x'x)  ^ 


* ^ "l  ‘>«  • • • ‘’n-1 


Pi  1 P^ 


''n-l  **0-2  ^n-3 


It  is  easy  to  show  that 


Var  (b)  » 


n-1 

y x.x.+l 


n-2 

*iV2 

i“l  


If  a were  known,  then  the  usual  least  squares 


estimator  of  the  variance 


. Hence  if  the 


x^  are  autocorrelated  with  the  same  sign  as  the 
p|^  then  the  ordinary  least  squares  estimator  will 

underestimate  the  true  variance  of  bi  if  auto- 
correlated with  opposite  sign,  the  estimator  will 
overestimate  the  variance  of  b. 

Similarly  it  can  be  shown  that  the  residual 
sum  of  square  for  least  squares  estimator  has 

expectation  (n-K) 


In  estimatin9  the  same  relationships  hold  as 

above  accentuating  the  bias  in  estimating  the 
variance  of  b using  ordinary  least  squares. 

It  should  bo  noted,  however,  that  if  the 
are  uncorrelatcd,  the  affect  of  the  auto- 

correlated  errors  t’ill  likely  be  negliblc.  In 
fact  in  this  case  the  estimators  are  asymptoti- 
cally unbiased. 


The  word  malaria  means  "bad  air".  This  term 
came  into  usage  because  it  was  thought  that 
people  contracted  the  disease  from  the  air 
present  in  swampy,  lowlying  areas  when  in  fact 


the  only  known  carrier  is  the  anopheles 
mosquito. 
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